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Abstract 

The problem of a restricted random walk on graphs which keeps 
track of the number of immediate reversal steps is considered by using 
a transfer matrix formulation. A closed- form expression is obtained for 
the generating function of the number of n-step walks with r reversal 
steps for walks on any graph. In the case of graphs of a uniform 
valence, we show that our result has a probabilistic meaning, and 
deduce explicit expressions for the generating function in terms of the 
eigenvalues of the adjacency matrix. Applications to periodic lattices 
and the complete graph are given. 
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1 Introduction 



The problem of random walks on lattices has been of pertinent interest in 
mathematics and physics for decades [p]] . Very recently, the study of random 
walks also arises in the theory of periodic orbits in quantum graphs 0. In 
that study one considers random walks on a graph while keeping track of 
aspects of steps which are immediate reversals of the previous steps, leading 
to a problem of restricted walks. As is common in analyses of self-avoiding 
walks ||, the consideration becomes difficult because of the prohibition of 
returning to previously visited sites. As a result, the walk problem in quan- 
tum graphs has remained largely unsolved. Here we introduce and solve a 
restricted walk problem on graphs which is simpler and more natural in its 
mathematical formulation. It is hoped that this solution will shed light on 
self-avoiding walks and the yet unsolved problem of quantum graphs. 

Consider a graph G of q sites (vertices) numbered from 1 to q. Starting 
from a site po, a walker begins a walk by taking "steps" along the edges of G. 
A step from site Pi to site pj is a reversal if it is taken immediately after a step 
from pj to Pi, namely, if it reverses the preceeding step. We are interested 
in computing N njr (p ,p n ), the number of n-step walks starting from a site p 
and ending at site p n , which may or may not coincide with p , with r (< n) 
reversal steps. 

Introduce the generating function 

n-l 

Z n (z\p ,p n ) = Z T N ntr (po,Pn)- (1) 

Clearly, we have Z n (0\p ,p n ) = N nt0 (p ,p n ). It is also clear that Z n (l\p Q ,p n ) 
is the total number of n-step walks from p to p n , regardless whether there 
are reversals. It is also useful to introduce 

q 

W n (z\p ) = Z n (z\p ,p n ) 

Pn = l 

n-l 

= Yt^MnAPo) (2) 
r=0 

as the generating function of all n-step walks which originate fromp - Clearly, 
Mn^po) is the number of n-step walks starting from p Q with r reversals, 
regardless of the ending site. 
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Let A be the q x q adjacency matrix of G with elements 

Aij =< i\A\j > = 1 if i, j are connected by an edge 

= otherwise. (3) 

It is well-known M, [5| that we have 

Z n (l\p ,p n ) = < Po\ A \Pl >< Pl\ A \p2 > ■ ■ ■ < Pn-l\A\p n > 

PiP2---Pn-l 

= <p \A n \p n >. (4) 

Here, in (|]) and hereafter, all summations are taken from 1 to q unless 
otherwise stated. 

To compute the generating function Z n (z\p ,p n ) for general z, we intro- 
duce a q x q matrix W with elements 

W .. = i + (z _ i)5.., ( 5 ) 

where 5 is the Kronecker delta, with z = corresponding to the case of no 
reversals. Then, instead of (||), we have the expression 

Z n {z\po,Pn) = X! AwnAnP2 ' ' ' \ n -iPvW PoPQ W PlP3 ■ ■ ■ W Pn _ 2Pn . (6) 

PlP2---Pn-l 

A graphical representation of the summand in (|6]) is depicted in Fig. 1. Note 
that arrows indicate the sequence of steps taken. 




Figure 1: Graphical representation of @. Arrows denote the sequence of 
steps as well as the order in which indices of matrix elements appear in (|i~3|) . 
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Graphs of uniform valence: If all sites of G have the same valence v, such 
as in a complete graph or a lattice with periodic boundary conditions, then 
the walker has v choices for the first step, and for each of the remaining n — 1 
steps, the walker either returns to the previous site with a weight z or walks 
to any of the v — 1 remaining neighboring sites. Then, after summing over 
all ending sites, we have 

W n (z\p )=v(z + v-l) n -\ (7) 

from which one obtains 

M n<r (p )=v^~ i y v -ir- 1 . (8) 

Furthermore, the generating function Z n can be associated with a probabilis- 
tic meaning. Consider n-step walks for which the walker starts from site i 
and ends at j. At the first step the walker can choose any of the v neigh- 
boring sites with an equal probability u -1 . At step two and thereafter, the 
walker makes an immediate reversal with a probability p\ and walks to any 
of the remaining v — 1 neighboring sites with a probability P2 subject to 

pi + (v - l)p 2 = 1. (9) 

Then, the probability that the walker will end at site j after n steps is 

Pn(i,j) = V-^PlPr^NnAhj) 
r=0 

= v- 1 p n 2 - 1 Z n {p 1 /p 2 \i l3 ). (10) 
Indeed, using (|J), (0) and (|), one verifies that 

E^(i,j) = l. (11) 

3 

2 Transfer matrix formulation 

Returning now to walks on an arbitrary graph, it is convenient to introduce 
a q 2 x q 2 transfer matrix T with elements 

<ij\T\£k>=A ij W ik 6 ej , (12) 
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or more simply 



< ij\T\jk >= AijW ik 



and a q 2 x q matrix Co with elements 

C (ap\p n ) = A a/3 5p Pn 
as depicted by the heavy line in Fig. 1. One can then rewrite (^j) as 

Z n {z\p ,Pn) = £ < P0Pl\T\piP2 >< PlP2\T\p 2 P3 > ■ ■ ■ 

pi—p n -ip 

X < Pn-2Pn-l\T\p n -\P > C (p n -lP\Pn) ■ 



(13) 
(14) 



(15) 



Note that matrix elements in (0) and fllBD are indexed in the order along 
the arrows in Fig. 1. Further introduce the recursion relation 



C m+ i(ij\p) = J2< i 3\ T \3 k > C m (jk\p), 
k 



m = 0,l,2,---. (16) 



and the notation 



\P) = ^CmiijlP), 



(17) 



then for walks ending at site p the recursion relation ( |i~6D leads to 



C m+2 {ij\p) 



A; 



A; 



«m+lO'b) + ( z ~ l ) C m+l{ji\p) 



a m+i{j\p) + {z- l)a m (i\p) + (z- l) 2 C m (ij\p) 
m = 0,1,2, 



(18) 



Here, we have iterated the first line once and made use of (|5|) and (|13|) and 
the identity A 2 , = Am = Aji. For walks starting at site i and ending at site 



p, we have by combining (14) and (|16"D the boundary condition 

a (i) = Ai. 



Hp 
2 



W\ IP + {z - l)vA 



tp 



where 



£^4 



(19) 
(20) 
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is the valence of the site i. In addition, we have the identity 

Z n (z\i,p) = a n -i(i\p). (21) 



Thus, the crux of matter is to analyze the recursion relation 

Summing (Jf^) over j and defining g-component vectors a m (p), m 
1, 2, • • • , q, whose components are a m (i\p),i — 1, 2, • • • , q, we obtain 



d m+2 (p) = Aa m+1 (p) + Ba m (p), 
where B is a q x q diagonal matrix with elements 



m = 0,1,2, 



B 



(z - l)(Vi + Z - l)Sij. 



Introducing the generating function 



G(t) = ^ t m a m (p), 

m=0 



(22) 



(23) 



(24) 



the summation of (P2j) from m = to oo after multiplying by t m then yields 



G{t) 



I — fB — tA 



a (p) + <«i(p) - tAdoip) 



(25) 



where I is the q x q identity matrix. Introducing fll9|) and the vector «oo(p) 
with elements 

ooo(*b) = ^ip, i = l,2,---,g, (26) 

one obtains 



G{t) 



I — t 2 B — tA 



A + (z- l)tV 



ooo(p), 



(27) 



where V is a g x g diagonal matrix with elements V^j = ViSij. 

Finally, after combining (E^) and fl2"3f), we identify the generating function 
Z n (z\i,p) for n-step walks from i to p as the coefficient of t n_1 in the i-th 



component of fl27). This is a very general result which holds for any graph. 



6 



3 Graphs of uniform valence 

In this section we apply the result of the preceeding section to graphs of a 
uniform valence, such as lattices with periodic boundary conditions and a 
complete graph. Let v i = v for all i, then B = 61, V = vl, where 



b=(z-l)(v + z-l), 
and the inverse matrix in fl2"7| ) can be expanded to yield 



G(t) = E E 

n=0£=0 



n + 



ib i t n+2i A n 



A+ (z-l)vtl 



a o(p). 



(28) 



(29) 



Using a 00 (p) given by (p6|) , we obtain after a little reduction the following 
explicit expression for the i-th component of G(t), 



[G(t)) t 



i - 6i 2 r x A 



+ EE^ 

n=l£=0 



I ,n+2l 



ip 

n + 



A n+1 + (z- l)v 



A 



n-l 



•(30) 



ip 



Thus, we find 

Z2(z\i,p) ■ 
Z 3 (z\i,p) ■ 
Z 4 (z\i,p) ■■ 



[A 2 + (z- l)vl] ip 
[A 3 + (z-l)(2v + z-l)A} ip 

[A 4 + (z - l)(3v + 2z- 2)A 2 + (z- lfv{v + z- 1)1]., 
etc. 



(31) 



It is now clear that results ( p9|) and ( j3l|) can be expressed in terms of the 
eigenvalues Aj of the adjacency matrix A. Note also that, by using fliTf), the 
generating function Z n (z\i,p) gives the probability that a walker will arrive 
from i to p in n steps with an immediate reversal probability z/(l + z) at all 
steps. 

For walks returning to the starting point, namely, i = p, we use the 



identities A 



pp 

Z 2 (z\p,p) 
Zz{z\p,p) 

Z 4 (z\p,p) 



0,(A 2 



v to obtain 



'pp ~ 

vz 
[A 3 

[A 4 ] pp + v(z - 1)(, 2 - 1) + v\z -l)(z + 2). (32) 



pp 
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Furthermore, if all sites are equivalent, such as in a complete graph or a 
lattice with periodic boundary conditions, we have the simple relation 



[A ri 



pp 



(33) 



i=l 



For walks on an N\ X N 2 x • • • x Nd d- dimensional hypercubic lattice, for 
example, this becomes 



ATi N 2 N d f d 

[AT„ = (N,N 2 ...N,)- 1 ^ E • • • E E e2mnJNd 

ni=lrt2=l tij=l a=l 



lpp 



(34) 



which reduces to the usual expression of the number of walks returning to 
the origin on an infinite lattice || after replacing the sums by integrals in 
the limit of N a — > oo,a — 1, ■ ■ ■ ,d. For the complete graph it can be shownQ 
that the solution also assumes the form 



Z n (z\i,p) = (q + z- 2) n -\l - 5 ip ) + (q5 ip - 1)[B 



n-li 



J2H 



(35) 



where 



/0 q + z-2 \ 

B = z q - 2 , (36) 

\1 q + z-3j 

and the subscript {21} denotes the {21}-th element. This gives, among other 
results, the following explicit expressions for walks without reversals at all 
steps, 



Z2(0\p,p) 


= N 2>0 (p,p) 


= 










= N 3j0 (p,p) 


= (?- 


!)(?- 


2) 




Z 4 (0\p,p) 


= N Afi (p,p) 


= (?- 




2)(g- 


3) 


z 5 (o\p,p) 


= N Bt0 (p,p) 


= (?- 




2)(g- 


3) 2 


Z e (0\p,p) 


= N 6fi (p,p) 


= (9- 


!)(?- 


2)(g 3 - 


- 8g 2 + 23g 



1 For the complete graph the problem can be solved very simply by regarding the walker 
to be in three "states" : the starting site, just stepping off the starting site, and others. This 
leads directly to (pq). We are indebted to the referee for pointing out this consideration. 
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4 Summary and discussions 



We have presented a transfer matrix formulation for enumerating n-step 
walks on a graph with r reversal steps, and obtained a closed-form expression 
for the generating function Z n (z\i,p) in the form of ([27]). We have also de- 
duced explicit expressions for the generating function in the case of a uniform 
valence v, with the results given in terms of the eigenvalues of the adjacency 
matrix, and showed that in this case the generating function possesses a 
probabilistic meaning. 

The transfer matrix approach can be extended to other restricted self- 
avoiding walks. For walks having a 2-step memory of not stepping into the 
two immediate preceeding sites, for example, the generating function flf]) 
can be similarly written down, and one needs to consider a q 3 x q 3 transfer 
matrix, where q is the number of sites in the graph. It is hoped that such 
considerations can shed light to the problem of self-avoid walks and the yet 
unsolved walk problems in quantum chaos. 
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